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SYSTEM, APPARATUS, AND METHOD FOR 
INCREASING RESILIENCY IN COMMUNICATIONS 

BACKGROUND OF THE INVENTION 

5 

A. Field of the Invention 

Systems, apparatus, and methods consistent with the present invention relate 
generally to data communications and, more particularly, to systems, apparatus, and 
methods for increasing resiliency of data communications. 

10 

B. Description of Related Art 

Transmitting data reliably in a network requires transmitting and receiving 
systems to process data in the same way. For example, if the transmitting system 
scrambles data, the receiving system must descramble the data in the same manner in 
15 which it was scrambled. Standards often define how transmitting and receiving systems 
should process data. The Synchronous Optical NETwork (SONET) standard is one 
such standard. 

SONET was developed for transporting data over optical links. In SONET, data 
is transmitted in a SONET payload envelope (SPE). SONET is sometimes used to 

20 transport other protocols. For example, standards have been developed for 

transporting Point-to-Point Protocol (PPP) data over SONET. One approach to PPP 
over SONET is described in a paper entitled "PPP Over SONET (SDH) at Rates From 
STS-1 (AU-3) TO STS-192c (AU-4-64c/STM-64)," S. Merchant (prepared for the PPP 
Extensions Working Group, 1998) ("Merchant"), the contents of which are hereby 

25 incorporated by reference. 

Merchant describes encapsulating data in a frame format similar to the frame 
format used in the High-level Data Link Control (HDLC) protocol. The HDLC-like frame 
is then placed in the SPE for transport over SONET. The data is delineated with a 0x7e 
flag at the beginning of the data and the same flag, 0x7e, at the end of the data. 

30 Therefore, 0x7e followed by a data value indicates the start of an HDLC frame, and a 
data value followed by 0x7e indicates the end of an HDLC frame. 
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A problem arises, however, if a data byte between the 0x7e flags happens to 
also equal 0x7e. To solve this problem, the data values are analyzed. Each single byte 
0x7e data value is replaced, or "escaped," by the two-byte value 0x7d 0x5e. This 
operation is referred to as byte expansion because one byte is replaced by two bytes. 
5 On the receiving end, the receiving system passes 0x7e values until a non-0x7e 

value is received, meaning a data stream has started. When the receiving system 
encounters the two-byte 0x7d 0x5e sequence in the data, it converts the sequence back 
to 0x7e. This solves the problem of flag values appearing in the data. 

But this raises another problem. How does the receiving end know when 0x7d is 
10 data, and when it is the first byte of the sequence 0x7d 0x5e? To solve this problem, 
the transmitting system also replaces each single byte 0x7d data value by the two-byte 
sequence 0x7d 0x5d. The receiving system, in addition to converting 0x7d 0x5e in the 
3 data back to 0x7e, also converts 0x7d 0x5d back to 0x7d. 

1 Byte expansion solves the problem of flag bytes appearing in the data, but 

1 1 5 unfortunately raises another. An attacker might use this property to overload a link by 
3 sending a long string of 0x7d and/or 0x7e data values. Since these single-byte values 

* are expanded to two bytes, the number of bytes is effectively doubled. This reduces 

bandwidth on the link by half. Thus, an attacker can reduce the bandwidth by sending 
f through a long string of 0x7d and/or 0x7e data values. 

I 20 Merchant proposes solving the byte expansion problem by scrambling the data 

J using an HDLC scrambler. Scrambling the data before the data is analyzed for flag 

values virtually eliminates the possibility of an attacker using byte expansion to halve 
the bandwidth. Thus, scrambling the values thwarts an attacker sending through all 
0x7d's and 0x7e's. 

25 One problem with using an HDLC scrambler, however, is that the receiving end 

HDLC descrambler might fall out of synchronization with the transmitting end HDLC 
scrambler. On the transmitting end, the HDLC scrambler only advances when packet 
data is coming through. Thus, during idle time, the HDLC scrambler is not advancing its 
state and the transmitting system is sending 0x7e inter-frame time fill bytes in each 

30 SPE. 
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A problem arises, however, when there is an error in one or more of the 0x7e 
inter-frame time fill bytes. If there is an error in one of the inter-frame time fill bytes, the 
receiving system interprets the byte as a data value because it no longer has a value of 
0x7e. On the receiving end the HDLC descrambler is active only when packet data is 
being received (e.g., bytes other than 0x7e inter-frame time fill bytes are being 
received). Thus, when there is an error in one of the inter-frame time fill bytes, the byte 
appears to not be an inter-frame time fill 0x7e byte, which causes the HDLC 
descrambler to advance during idle time, when it should not. This causes the receiving 
end HDLC descrambler to no longer be synchronized with the transmitting end HDLC 
scrambler because it has advanced based on an error, when it should not advance. 

When the next data packet is received at the HDLC descrambler, the packet will 
not be descrambled correctly because the HDLC descrambler is not in the correct state. 
Consequently, the packet will be thrown out. 

Therefore, there exists a need for systems, apparatus, and methods that 
maintain a link between two systems even when there are bit errors during slow 
transmission periods. 

SUMMARY OF THE INVENTION 
Systems, apparatus, and methods consistent with the present invention address 
this and other needs by replacing inter-frame time fill bytes with synchronization packets 
at the transmitting end. When each synchronization packet is received at the receiving 
end, the elements at the receiving end are resynchronized to the elements at the 
transmitting end. More particularly, systems, apparatus, and methods consistent with 
the present invention insert at the transmitting end runt abort packets during inter-frame 
time fill. The runt abort packets synchronize the descrambler at the receiving end with 
the transmitting end scrambler. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
The accompanying drawings, which are incorporated in and constitute a part of 

this specification, illustrate an embodiment of the invention and, together with the 

description, explain the invention. In the drawings, 

Fig. 1 is a block diagram of two network elements consistent with the principles 

of the invention; 

Fig. 2 is a block diagram of a transmitting system for inserting runt abort packets 
during inter-frame time fill, consistent with the principles of the invention; 

Fig. 3 is a flow chart illustrating the process performed by outgoing HDLC 
processing element 42, consistent with the principles of the invention; 

Fig. 4 is a block diagram illustrating incoming HDLC processing element 48, 
consistent with the principles of the invention; 

Fig. 5 is a block diagram showing an embodiment of an HDLC descrambler 
consistent with the principles of the invention; and 

Fig. 6 is a flow chart illustrating the processing performed by incoming HDLC 
processing element 46, consistent with the principles of the invention. 



DETAILED DESCRIPTION 

The following detailed description of the invention refers to the accompanying 
drawings. The same reference numbers in different drawings identify the same or 
similar elements. The following detailed description does not limit the invention. 
Instead, the scope of the invention is defined by the appended claims and equivalents 
of the claim limitations. 

Systems, apparatus, and methods consistent with the present invention insert 
information during idle time inter-frame time fill that refreshes a descrambler at the 
receiving end, thus preventing bit errors during inter-frame time fill from placing the 
descrambler in an erroneous state. In one embodiment, runt abort packets are inserted 
during inter-frame time fill and the receiving system flushes a descrambler upon 
receiving each runt abort packet. 

Fig. 1 is a block diagram of two network elements. In this embodiment, network 
element 36 transmits packets over SONET to network element 38. Network elements 
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36 and 38 are shown in simplified form for purposes of illustration and explaining the 
principles of the invention. In one embodiment, each of network elements 36 and 38 
includes elements for transmitting and receiving data over a variety of media using a 
variety of protocols. In one embodiment, network elements 36 and 38 are routers, each 
5 having elements for transmitting data over and receiving data from many types of media 
using many types of protocols. 

Network element 36 comprises network engine 40, outgoing HDLC processing 
element 42, and outgoing SONET processing element 44. Network element 38 
comprises incoming SONET processing element 46, and incoming HDLC processing 
10 element 48, and network engine 50. In one embodiment, network elements 36 and 38 
route packets and are connected to other network elements, networks, and processing 
systems. 

In one embodiment, network elements 36 and 38 transfer data using packets 
over SONET (POS) by framing packet data in an HDLC-like format. One example of 
15 POS is described in "PPP in HDLC-like Framing," RFC-1662, W. Simpson, editor, 

prepared for the Network Working Group, 1994 ("Simpson"), which is hereby expressly 
incorporated herein by reference. 

Outgoing HDLC processing element 42 receives packet data from network 
engine 40 and performs HDLC processing on the packet data. Outgoing HDLC 
20 processing element 42, in addition to performing operations consistent with principles of 
the invention, also performs operations similar to conventional HDLC processing 
elements, such as frame check sequence (FCS) operations and scrambling data. 

Consistent with the principles of the present invention, outgoing HDLC 
processing element 42 inserts runt abort packets between inter-frame time fill bytes 
25 during inter-frame time fill. The runt abort packets are preferably short. In one 

embodiment, the runt abort packets are less than six bytes long and may comprise, for 
example, a series of characters, such as "J," "N," "P," "R," "!." 

Each runt abort packet includes an indicator that the receiving end should abort 
the packet. In one embodiment, the abort byte sequence at the end of the packet is 
30 0x7d 0x7e. 
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After HDLC processing by outgoing HDLC processing element 42, the data is 
transferred to outgoing SONET processing element 44, which performs SONET 
processing on the HDLC frames. For example, outgoing SONET processing element 
44 scrambles the HDLC frames, loads them into a SONET payload envelope (SPE), 
and prepares the SONET frame for transport. The SONET frame is then output to 
another network element, such as network element 38. 

Incoming SONET processing element 46 receives the SONET frames, pulls out 
the HDLC frames from the SPEs, and sends them to incoming HDLC processing 
element 48. Incoming SONET processing element 46 performs conventional SONET 
processing operations corresponding to the SONET processing operations on the 
transmit side. For example, the SONET payload is descrambled by incoming 
processing element 46, and the payload data is removed from the SPE. 

Incoming HDLC processing element 48 receives the HDLC frames and pulls the 
packet data out of the frames. Incoming HDLC processing element 48 performs many 
operations corresponding to the HDLC processing operations on the transmit side. For 
example, the HDLC frame is descrambled by incoming HDLC processing element 48. 

When a runt abort packet is received by incoming HDLC processing element 48, 
the runt abort packet is run through a HDLC descrambler of incoming HDLC processing 
element 48, thus synchronizing the HDLC descrambler to the HDLC scrambler of 
outgoing HDLC processing element 42 at the transmit end. The runt abort packet is 
discarded because it is too short. 

During inter-frame time fill, the transmitting end sends out alternating runt abort 
packets and individual 0x7e inter-frame time fill bytes. In an alternative embodiment, 
runt abort packets are inserted between several inter-frame time fill bytes. If there is a 
bit error in a 0x7e inter-frame time fill byte, causing the HDLC descrambler to lose state, 
the next runt abort packet will flush the HDLC descrambler, placing it back in a correct 
state, synchronized with the transmit side HDLC scrambler. Thus, even if errors occur 
in inter-frame time fill bytes, the HDLC descrambler at the receiving end stays 
synchronized with the HDLC scrambler at the transmitting end. 

This solves the problem of conventional systems, which discard the next packet 
after a bit error in the 0x7e inter-frame time fill bytes. Conventional systems only 
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transmit 0x7e bytes during inter-frame time fill. If one of these bytes has an error, it is 
interpreted as a non-inter-frame time fill byte, causing the HDLC descrambler to 
advance during inter-frame time fill, when it should not advance. The HDLC 
descrambler should only advance when there is packet data. Because a bit error 
5 causes the descrambler to advance incorrectly during inter-frame time fill, a 

conventional system will not descramble the next packet correctly, and the packet will 
be discarded even though the packet may be valid. 

Fig. 2 is a block diagram of a transmitting system for inserting runt abort packets 
during inter-frame time fill, consistent with the principles of the invention. More 

10 particularly, outgoing HDLC processing element 42 comprises runt abort insert 20, FCS 
insert 24, HDLC scrambler 28, HDLC abort and flags 30. Data to be transmitted is fed 
to runt abort insert 20 from a queue (not shown). If there is data in the queue, runt abort 
insert 20 forwards the data to FCS insert 24. 

During idle time the queue is empty. Since there is no data in the queue, runt 

15 abort insert 20 forwards an alternating sequence of inter-frame time fill bytes (0x7e) and 
runt abort packets to FCS insert 24. Each runt abort packet is preferably less than six 
bytes long and is marked with an indicator that it should be aborted at the receiving end. 

In one embodiment, a random number generator is used to generate the runt 
abort data bytes. This adds randomness to the scrambler state. If there were ever a 

20 problem in which packet data was not sufficiently random to ensure a random scrambler 
state, this would solve that problem. 

FCS insert 24 receives packet data, runt packets, or inter-frame time fill bytes 
from runt abort insert 20. If packet data or a runt packet are received, FCS insert 24 
runs a frame check sequence over the bytes, appends the FCS result, and forwards the 

25 bytes and FCS result to HDLC scrambler 28. Inter-frame time fill bytes are simply 
forwarded to HDLC scrambler 28. 

HDLC scrambler 28 only runs on packet data, not when 0x7e inter-frame time fill 
bytes are received. Therefore, HDLC scrambler 28 scrambles both the data that comes 
from the queue through runt abort insert 20, as well as the runt abort packets created by 

30 runt abort insert 20. In one embodiment, HDLC scrambler 28 is an x A 29 + 1 self- 
synchronous scrambler. 
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HDLC scrambler 28 scrambles the bits and forwards the scrambled bits to HDLC 
abort and flags 30. HDLC abort and flags 30 adds 0x7e flags to the beginning and end 
of the scrambled information to form an HDLC frame. If a packet was marked by runt 
abort insert 20 as a runt abort packet, HDLC abort and flags 30 appends a special two- 
5 byte character, 0x7d 0x7e at the end of the scrambled bytes. This two-byte character 
indicates to the receiving end that the packet should be aborted. Finally, HDLC abort 
and flags 30 forwards the HDLC frames to outgoing SONET processing element 44 for 
SONET processing. SONET processing element 44 performs conventional SONET 
processing on the HDLC frames and inter-frame time fill bytes. 
10 Fig. 3 is a flow chart illustrating the process performed by outgoing HDLC 

processing element 42. Outgoing HDLC processing element inserts runt abort packets 
during inter-frame time fill (step 64), calculates and inserts a frame check sequence 
based on packet bytes (step 66), scrambles the packet bytes (step 68), and marks runt 
abort packets and encapsulates the packet bytes with flags to form HDLC frames (step 
iJ1 15 70). Each of the steps is described in greater detail in the description of Fig. 2. 

Fig. 4 is a block diagram illustrating an embodiment of incoming HDLC 
processing element 48. Incoming HDLC processing element 48 operates on data 
received from incoming SONET processing element 46. HDLC processing element 48 
comprises HDLC abort and flag check 80, HDLC descrambler 82, bytes < 6 removal 84, 
20 and FCS checker 86. 

HDLC abort and flag check analyzes the incoming bytes for start of frame, end of 
frame, and abort sequences. 0x7e values, indicating inter-frame time fill, are discarded 
until a non-0x7e value is received, indicating data. Data bytes are forwarded to HDLC 
descrambler 82. 

25 HDLC abort and flag check 80 checks the incoming bytes to determine whether a 

0x7d 0x7e abort sequence has been added to a packet, indicating the packet should be 
aborted. All runt abort packets include this byte sequence. HDLC abort and flag check 
80 forwards non-inter-frame time fill packet data to HDLC descrambler 82. In one 
embodiment, HDLC descrambler 82 is an x A 29 + 1 self-synchronous descrambler. 
30 HDLC descrambler 82 descrambles the data and forwards the descrambled data to 
bytes < 6 removal 84. 
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Bytes < 6 removal 84 discards packets having a byte length less than six bytes 
long. Thus, all runt abort packets are discarded at this point. Packets six bytes or 
longer are forwarded by bytes < 6 removal 84 to FCS checker 86, which performs FCS 
operations on the packet and checks the results against the FCS information appended 
5 to the packet. 

Fig. 5 is a block diagram showing an embodiment of descrambling elements of 
HDLC descrambler 82 consistent with the principles of the invention. More particularly, 
Fig. 5 shows a particular arrangement of elements for descrambling bits that may be 
used in HDLC descrambler 82. HDLC descrambler 82 may also include other elements 

10 for processing the incoming bits. 

The descrambling elements comprise 29-bit shift register 120 connected to 
exclusive-OR element 122. Scrambled bits from the transmitting end are input to 
exclusive-OR element 122 and the input of 29-bit shift register 120. Exclusive-OR 
element 122 logically exclusive-ORs the incoming scrambled bits with the output of 29- 

15 bit shift register 120, and outputs descrambled data. This operation is the reverse of the 
scrambling operation performed at the HDLC scrambler at the transmitting end. 

is flushed out by every 29 bits of incoming scrambled data. An error in the bits of 
scrambled inter-frame time fill bytes causes the shift register to go out of 
synchronization with the transmitting end scrambler. The next runt abort packet, 

20 however, resynchronizes 29-bit shift register 120 by flushing any errors out of the shift 
register. Even though the runt abort packet will not be descrambled correctly when 
there is an error in 29-bit shift register 120, the runt abort packet will place the shift 
register in a correct state. Subsequent scrambled data will be descrambled correctly. 
This minimizes the impact that errors in inter-frame time fill bytes have on descrambling 

25 data. 

Fig. 6 is a flow chart illustrating the processing performed by incoming HDLC 
processing element 46. Incoming HDLC processing element 46 first checks the 
incoming data for abort and flag information (step 100), descrambles the data (step 
102), removes packets having a byte length less than six bytes (step 104), and 
30 performs FCS checking operations on the data (step 106). Each of the steps is 
described in greater detail in the description of Fig. 4. 
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CONCLUSION 

Systems, apparatus, and methods consistent with the principles of the invention 
insert runt abort packets at a transmitting system during inter-frame time fill to minimize 
the impact of a bit error during inter-frame time fill. At a receiving system, the runt abort 
packets flush a descrambler. Flushing the descrambler removes any false advances of 
the descrambler that might have resulted from a bit error in an inter-frame time fill byte. 

The foregoing description provides illustration and description, but is not 
exhaustive. The invention is not limited to the precise form disclosed. Modifications 
and variations are possible in light of the above teachings or may be acquired from 
practice of the invention. The scope of the invention is defined by the claims and 
equivalents of the claim limitations. 
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